Image-space Free-viewpoint Video
نویسندگان
چکیده
Image-space free-viewpoint video (FVV) is a framework for representation and coding of sparse multi-view video and subsequent re-rendering from arbitrary viewpoints. It is based on the fundamental concept of storing all information describing a scene’s visual appearance in multi-channel video images. Each pixel’s channels define different attributes of discrete point samples of observed surfaces. In this paper, we show how image-space FVV can be implemented with standard video coding tools and ready-available video coding methods can thus be reused. Besides, this representation has been adopted as extension of the MPEG-4 AFX standard. In addition to the representation, we also introduce a novel video coding technique that allows random access and progressive transmission. We evaluate this new codec in the context of FVV and compare it to state-of-the-art image and video codecs like MPEG-4 and JPEG-2000. We present results based on real-world data proving the suitability of the chosen approach.
منابع مشابه
Projective Surface Refinement for Free-Viewpoint Video
This paper introduces a novel method of surface refinement for free-viewpoint video of dynamic scenes. Unlike previous approaches, the method presented here uses both visual hull and silhouette contours to constrain refinement of viewdependent depth maps from wide baseline views. A technique for extracting silhouette contours as rims in 3D from the view-dependent visual hull (VDVH) is presented...
متن کاملUsing Multi - view Video Coding
We propose a video communication method that lets the user freely change his/her viewing position and viewing direction. Free-viewpoint video is a next-generation visual application that has been extensively studied and discussed by the international MPEG standard body as 3DAV (three-dimensional audio and visual). For this application, we propose a multi-view video coding method and communicati...
متن کامل3DTV view generation using uncalibrated pure rotating and zooming cameras
This paper proposes a novel method for synthesizing free viewpoint video captured by uncalibrated pure rotating and zooming cameras. Neither intrinsic nor extrinsic parameters of our cameras are known. Projective grid space (PGS), which is the 3D space defined by the epipolar geometry of two basis cameras, is employed for weak camera calibration. Trifocal tensors are used to relate non-basis ca...
متن کاملParallax-Free Registration of Aerial Video
Aerial video registration is traditionally performed using 2-d transforms in the image space. For scenes with large 3-d relief, this approach causes parallax motions which may be detrimental to image processing and vision algorithms further down the pipeline. A novel, automatic, and online video registration system is proposed which renders the scene from a fixed viewpoint, eliminating motion p...
متن کاملSpacetime Tetrahedra: Image-Based Viewpoint Navigation through Space and Time
We present a purely image-based rendering system to viewpoint-navigate through space and time of arbitrary dynamic scenes. Unlike previous methods, our approach does not rely on synchronized and calibrated multi-video footage as input. Instead of estimating scene depth or reconstructing 3D geometry, our approach is based on dense image correspondences, treating view interpolation equally in spa...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2005